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[Title of the Document] Specification 

[Title of the Invention] ELECTRONIC CAMERA AND RECORDING AND 

REGENERATING METHOD THEREIN 

[Claims for the Patent] 
[Claim 1] 

An electronic camera, characterized by comprising: 

an imaging part which captures a subject image; 

a record medium which records captured image data; and 

audio regeneration means which regenerates sound or communication means which 
communicates with an external device which is capable of performing audio regeneration, 

wherein when the subject image is captured, audio regeneration information which at least 
indicates where sound during audio regeneration is stored is recorded in the record medium together 
with the captured image data. 
[Claim 2] 

An electronic camera, characterized by comprising: 
an imaging part which captures a subject image; 

display means which displays an image or image signal output means which externally 
outputs an image signal, in accordance with the image data recorded in the record medium in claim 
l;and 

audio regeneration means which regenerates sound or communication means which 
communicates with an external device which performs audio regeneration, 

wherein the image data and the audio regeneration information recorded in the record 
medium are read out, and the image is displayed in accordance with the image data while 
regenerating sound at image-capturing in accordance with the audio regeneration information. 
[Claim 3] 

A recording and regenerating method of an electronic camera, comprising the steps of: 
regenerating sound in accordance with audio data which is recorded in a first record 
medium; 
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recording image data representing a subject in a second record medium at image-capturing, 
and recording, in the second record medium, audio regeneration information which indicates where 
the sound is stored at the image-capturing; and 

regenerating an image in accordance with the image data recorded in the second record 
medium, and regenerating the sound at the image-capturing in accordance with the audio 
regeneration information which is recorded together with the image data and also in accordance 
with the audio data which is recorded in the first record medium. 
[Claim 4] 

The recording and regenerating method of the electronic camera as defined in claim 3, 
characterized in that the first record medium and the second record medium are identical. 
[Claim 5] 

The recording and regenerating method of the electronic camera as defined in claim 3 or 4, 
characterized in that: 

the audio regeneration information includes an elapsed time between a start point of the 
regenerating of the sound and a point of the image-capturing; and 

the regenerating of the sound in accordance with the audio regeneration information starts 
from the elapsed time. 
[Claim 6] 

The recording and regenerating method of the electronic camera as defined in claim 3 or 4, 
characterized in that: 

the audio regeneration information includes an elapsed time from a: start point of the 
regenerating of the sound; 

the regenerating of the sound in accordance with the audio regeneration information starts at 
a predetermined time before the elapsed time; and 

the regenerating of the image starts at the elapsed time. 
[Claim 7] 

The recording and regenerating method of the electronic camera as defined in claim 3 or 4, 
characterized in that: 

the audio regeneration information includes an elapsed time from a start point of the 
regenerating of the sound and an order of regeneration; 
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the regenerating of the sound in accordance with the audio regeneration information is 
successively performed by following the order of regeneration; and 

in the regenerating of the image, the image is regenerated by successively changing a 
corresponding image whenever reaching at the elapsed time. 
[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

The present invention relates generally to an electronic camera and its recording and 
regenerating method, particularly to an electronic camera and its recording and regenerating method 
which can perform audio-regeneration and image-capture or image-regeneration simultaneously. 
[0002] 

[Conventional Art] 

When regenerating an image which has been captured by an electronic camera for recording 
a still image and/or a moving image in a record medium and simultaneously regenerating sound by 
linking audio data of another audio medium corresponding with the regenerated image, the user 
controls the audio regeneration of the audio medium while looking at the displayed image. 
[0003] 

[Problems to be Solved by the Invention] 

However, by the conventional method, the user always has to control the audio regeneration 
of the audio medium, and in such case errors may occur during operation. 
[0004] 

The present invention has been developed in view of the above-described circumstances, and 
has as its object the provision of an electronic camera and its recording and regenerating method in 
which sound that corresponds with a captured image is automatically regenerated so that the image 
and the sound can be easily appreciated simultaneously. 
[0005] 

[Means for Solving the Problems] 

In order to achieve the above-described object, the invention according to claim 1 is directed 
to an electronic camera, characterized by comprising: an imaging part which captures a subject 
image; a record medium which records captured image data; and audio regeneration means which 
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regenerates sound or communication means which communicates with an external device which is 
capable of performing audio regeneration, wherein when the subject image is captured, audio 
regeneration information which at least indicates where sound during audio regeneration is stored is 
recorded in the record medium together with the captured image data. 
[0006] 

According to the present invention, the audio regeneration information indicating at least 
where the sound during the audio regeneration is stored is recorded in the record medium together 
with the captured image data when image-capturing. Thus, the sound corresponding with the 
captured image can be automatically regenerated, so that the image and the sound can be easily 
appreciated simultaneously. 
[0007] 

Moreover, in order to achieve the above-described object, the invention according to claim 2 
is directed to an electronic camera, characterized by comprising: an imaging part which captures a 
subject image; display means which displays an image or image signal output means which 
externally outputs an image signal, in accordance with the image data recorded in the record 
medium in claim 1; and audio regeneration means which regenerates sound or communication 
means which communicates with an external device which performs audio regeneration, wherein 
the image data and the audio regeneration information recorded in the record medium are read out, 
and the image is displayed in accordance with the image data while regenerating sound at 
image-capturing in accordance with the audio regeneration information. 
[0008] 

According to the present invention, the sound corresponding with the image can be 
automatically regenerated in accordance with the audio regeneration information which is recorded 
in the record medium; hence the image and the sound can be easily appreciated simultaneously. 
[0009] 

[Embodiments of the Invention] 

Hereunder a preferred embodiment of an electronic camera and its recording and 
regenerating method of the present invention will be described in accordance with accompanying 
drawings. 
[0010] 
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Figure 1 is a block diagram showing an embodiment of an electronic camera according to 
the present invention. An electronic camera 8 and an audio regeneration device 70 as external 
equipment are connected to each other through a communication line 72 in Figure 1 ; however, the 
present invention is not limited to this configuration and the audio regeneration device 70 can be 
built in the electronic camera 8. 
[0011] 

An optical system of the electronic camera 8 comprises a lens 10 which can adjust focus, an 
iris 12 for adjusting amount of light, and a solid-state imaging device (e.g., charge-coupled device: 
CCD) 14 for converting image into an electric signal. The image signal which is obtained by the 
CCD 14 goes through an analog process circuit and an A/D converter both of which are provided in 
an image signal processing part 16 so as to obtain digital R, G, and B signals. 
[0012] 

The CCD 14 and the image signal processing part 16 are synchronized and driven by a 
timing signal which is outputted from an imaging timing control part 18. The timing signal 
outputted from the imaging timing control part 18 can be changed by an instruction from a control 
part 22, hence a frame rate and a number of pixels can be set without limitations. In addition to 
the above-mentioned features, the image signal processing part 16 performs the changing a size of 
an image, sharpness correction, gamma correction, contrast correction, white balance correction, 
and so forth. 
[0013] 

The R, G, and B signals, outputted from the imaging signal processing part 16, are 
sequentially stored in a buffer memory 20 temporally via a bus line 24. 
[0014] 

The control part 22 can have a TTLAE function, in which brightness component of an image 
is extracted from obtained digital signal values of an image, a brightness level of a subject is 
obtained by integrating the brightness component with respect to a predetermined area, and an 
exposure power (iris and shutter speed) required for image-capturing is obtained from the 
brightness level of the subject. 
[0015] 
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In the inside of the control part 22, there are provided a RAM as a readable and writeable 
memory means (not shown) and a ROM which stores a program and fixed numbers that govern 
operations of the control part 22. 
[0016] 

An input unit 26 of the electronic camera 8 is provided with a shutter button, a function 
switch, a cursor key, a determining switch, an image regeneration button, a NEXT button, an image 
regeneration end button, and so forth, all of which are not shown, and operation data of each is 
transmitted to the control part 22. 
[0017] 

Audio record system of the electronic camera 8 comprises folio wings: microphones 28 and 
28 for converting an audio signal into an electric signal, microphone amplifiers 30 and 30 for 
amplifying a feeble audio signal which is outputted from the microphones 28 and 28, a sampling 
rate generator 32 for producing a designated sampling rate which is instructed by the control part 22 
and for generating the sampling rate, A/D converters 34 and 34 for sampling the audio signal in 
response to the sampling rate and converting the audio signal into digital data, compressors 36 and 
36 for reducing an amount of the digital data, and a multiplexor 38 for combining right and left 
channels of the audio data and transmitting the data to the bus line 24. 
[0018] 

The bus line 24 is provided with a compression-expansion processing part 40 and a 
recording-regenerating processing part 44. The compression-expansion processing part 40 
compresses the image data and the audio data by a method such as MJPEG and MPEG, and 
expands the compressed data. The recording-regenerating processing part 44 converts the data in 
order to record/read out the image data and the audio data to/from a record medium 42. The 
memory medium 42 may be a detachable memory medium such as a memory card and an MO. 
[0019] 

The electronic camera 8 is also provided with a communication signal processing part 46 
and a communication timing control part 48. The communication signal processing part 46 
transmits the image data and the audio data to external equipment through communication, and 
communicates with a connected audio regeneration device 70. The communication timing control 
part 48 controls a communication speed. In Figure 1, the electronic camera 8 and the audio 
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regeneration device 70 are connected to each other through the communication line 72; thus 
exchanging of data such as audio regeneration track number and a regeneration time, and 
bi-directional communication of a command signal and the like are possible. Regenerated sound 
of the audio regeneration device 70 can be monitored through an audio monitor 74. 
[0020] 

The audio regeneration device 70 is constructed to be able to perform audio regeneration by 
operating an operation button which is provided to the device itself. The audio regeneration 
device 70 can also transfer a command via the communication line 72 so as to automatically 
regenerate data. 
[0021] 

In order to regenerate the image data recorded in the record medium 42, the electronic 
camera 8 appropriately expands the data which is read out by the recording-regenerating processing 
part 44 at the compression-expansion processing part 40, and converts the data at a regeneration 
signal processing part 52 into a displayable signal and into a signal form which can be outputted to 
the outside in accordance with a timing signal which is outputted from a regeneration timing control 
part 54. The converted signal is transmitted to display means 56 and a captured image is displayed. 
The electronic camera 8 may output the image signal to the outside from the regeneration signal 
processing part 52 instead of displaying the image on the display means 56. 
[0022] 

In order to regenerate the audio data which is recorded in the record medium 42, the audio 
regeneration device 70 appropriately expands the data which is read out by the 
recording-regenerating processing part 44 at the compression-expansion processing part 40, and 
separates the audio signals to respective channels at a demultiplexer 58 so as to transmit the data to 
data expansion parts 60 and 60. Each audio data which is expanded at the data expansion parts 60 
and 60 is transmitted to D/A converters 62 and 62, and is converted into an analog audio signal 
according to the sampling rate data which is generated from a sampling rate generator 64. Then, 
the audio data is outputted through output terminals 68 and 68 to the external equipment after 
quantization distortion of the data is attenuated by low-pass filters 66 and 66. 
[0023] 



Now a description will be given on an image-capturing process of the electronic camera 8 
which is constructed as described above. 
[0024] 

An image to be captured is formed on a light receiving face of the solid-state imaging device 
(CCD) 14 via the taking lens 10 and the iris 12. The subject image is photoelectrically converted 
into a charge signal at each sensor in the CCD 14 by an amount corresponding with an amount of an 
incident light. A timing signal is outputted from the imaging timing controller 18 whereby the 
charge signal which is accumulated in the CCD 14 is successively outputted, and processes such as 
amplifying the R, G, and B signals of the image data at the image signal processing part 16, 
decreasing noise, and converting the data into digital data, are performed. 
[0025] 

The control part 22 temporally stores the image data which is converted into the digital data 
in the buffer memory 20. The image data, stored in the buffer memory 20, is appropriately 
extracted and successively transferred to the regeneration signal processing part 52 then displayed 
on the display means 56. 
[0026] 

In the audio record system, the feeble audio signals which are outputted from the 
microphones 28 and 28 are amplified by the microphone amplifiers 30 and 30, and the sampling is 
performed on the audio signals by the predetermined sampling rate so as to convert the signals into 
digital data. The amount of the digital data is compressed by the data compression parts 36 and 36 
and the right channel and the left channel of the audio data are combined by the multiplexor 38, 
then the data is transmitted to the bus line 24. 
[0027] 

As pressing a shutter button which is provided to the input unit 26, the electronic camera 8 is 
set in a mode to record the subject image. Then the control part 22 successively records the image 
data which is temporally stored in the buffer memory 20 and the audio data which is obtained from 
the multiplexor 38. 
[0028] 

Figure 2 is a flowchart showing a process for capturing an image during the audio 
regeneration by using the electronic camera and its recording and regenerating method according to 
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the embodiment of the present invention. As the image-capturing mode is designated in the 

electronic camera 8, the program jumps to a sub routine in Figure 2. 

[0029] 

In a step S100 "AUDIO REGENERATION" in Figure 2, when a "REGENERATION 
BUTTON" which is provided to the audio regeneration device 70 is pressed, the program proceeds 
to S102 "AUDIO MANAGEMENT DATA", S104 "TRACK DATA", and S106 "PLAY TIME 
DATA". The program then executes reading out the audio management data such as date and title 
during regeneration, track data in which regenerating audio data is recorded, and play time data 
from the audio record medium. 
[0030] 

The program then proceeds to S108 "AUDIO REGENERATION COMPLETED?", and 
determines whether or not completion of the audio regeneration is designated. If the completion 
of the audio regeneration is not designated at S 108, the program returns to S 102. If the completion 
of the audio regeneration is designated, the program proceeds to SI 10 "END", and finishes the 
routine for audio regeneration, then returns to the original routine. 
[0031] 

When half-pressing the shutter button which is provided to the input unit 26 at SI 12 
"SHUTTER HALF-PRESSED", the program proceeds to SI 14 "CAPTURE IMAGE" and waits 
until the shutter button is fully pressed. The control part 22 of the electronic camera 8 starts 
communicating with the audio regeneration device 70 with respect to the communication signal 
processing part 46, and executes a process to receive the audio management data such as date and 
title which are read by the audio regeneration device 70 from the audio record medium, track data in 
which the regenerating audio data is recorded, and the play time data. The received data is 
temporally stored in the memory means (RAM) which is provided in the control part 22. 
[0032] 

As the shutter is fully pressed at SI 14 "CAPTURE IMAGE", the program proceeds to SI 16 
"START IMAGE DATA RECORDING", and goes on to a process for recording the captured 
image data to the record medium 42. 
[0033] 
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At SI 18 "RECORD Audio Tag 1", the audio management data which is received from the 
audio regeneration device 70 together with the captured image data is recorded to the record 
medium 42 as "Audio Tag 1". 
[0034] 

At SI 20 "RECORD Audio Tag 2", the track number data which is received from the audio 
regeneration device 70 together with the captured image data is recorded to the record medium 42 
as "Audio Tag 2". 
[0035] 

At SI 22 "RECORD Audio Tag 3", the play time data which is received from the audio 
regeneration device 70 together with the captured image data is recorded to the record medium 42 
as "Audio Tag 3". 
[0036] 

At S124 "Audio Tag 4 = NONE", the regeneration track order data is recorded together with 
the captured image data; however, nothing is recorded in the regeneration track data when the 
image is captured during the audio regeneration like the case of this embodiment. 
[0037] 

Next, at SI 26 "RECORD IMAGE DATA", the captured image data is recorded to the record 
medium 42. If the image-capturing mode is released, the program proceeds to the next SI 28 
"END", and this image-capturing routine is completed. In a case where the shutter is half-pressed 
without releasing the image-capturing mode, the program returns to SI 12 and again prepares for 
image-capturing. 
[0038] 

Figure 3 is a flowchart showing a process for recording an image while considering a link 
with the audio regeneration by using the electronic camera and its recording and regenerating 
method according to an embodiment of the present invention. When a link recording mode is 
designated in the electronic camera 8, the program jumps to the routine in Figure 3. 
[0039] 

At SI 30 "MEMORY ON" in Figure 3, a "MEMORY" switch of the audio regeneration 
device 70 is pressed, so that the audio regeneration device 70 is in a mode to set a tune and an order 
of tune to be regenerated. 
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[0040] 

At SI 32 "SELECT TUNE AND ORDER OF TUNE", an operation button of the audio 
regeneration device 70 is operated so as to program the tune and the order of tune to be regenerated. 
[0041] 

The program proceeds to S134 "AUDIO REGENERATION SWITCH ON" and S136 
"IMAGE-CAPTURING START SWITCH ON", so that the regeneration switch which is provided 
to the audio regeneration device 70 and the image-capturing start switch which is provided to the 
electronic camera 8 are pressed simultaneously. 
[0042] 

An execution program for the audio regeneration device 70 proceeds to S 138 "AUDIO 
MANAGEMENT DATA" and S140 "REGENERATION TRACK ORDER DATA", and executes a 
process to read out the audio management data such as date and title during regeneration and the 
audio track order data to be regenerated. 
[0043] 

The program then proceeds to the next SI 42 "START AUDIO REGENERATION" and 
waits for an image-capturing start data from the electronic camera 8. In a case where the 
image-capturing start data is obtained from the electronic camera 8, the program proceeds to S 146 
"TRACK DATA" and S148 "PLAY TIME DATA", and executes a process to read out the track 
data to which the regenerating audio data is recorded and the play time data. 
[0044] 

After that, the program proceeds to S 150 "ALL TUNES COMPLETED". If the audio 
regeneration of all tunes is completed, the program proceeds to S170 "END" and returns to the 
original routine after ending the routine for the audio regeneration. 
[0045] 

On the other hand, an execution program for the electronic camera 8 proceeds to S152 "I = 
0" when start of image-capturing is designated at S136. At SI 52, the program proceeds to SI 54 
"CAPTURE IMAGE" after substituting 0 for a variable indicating a number of recorded image or 
images. 
[0046] 
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At S154, "I = 0?" of S156 is determined. It is "I = 0" if the electronic camera 8 is in a state 
before starting capturing the first frame; thus the electronic camera 8 instructs the audio 
regeneration at SI 42 of the audio regeneration device 70 via a communication part. If "I = 0" is 
not determined at S156, the electronic camera 8 instructs at S146 to read out the track data during 
regeneration. 
[0047] 

At SI 57 "I = I + 1", in response to execution of capturing the first frame, a calculation is 
performed for adding 1 to the variable indicating the number of recorded image(s). Then, the 
program proceeds to S158 "START IMAGE DATA RECORDING", and the process moves on to 
recording of the captured image data to the record medium 42. 
[0048] 

At SI 60 "RECORD Audio Tag 1", the audio management data, received from the audio 
regeneration device 70, is recorded to the record medium 42 as "Audio Tag 1 " together with the 
captured image data. 
[0049] 

At SI 62 "RECORD Audio Tag 2", the track number data, received from the audio 
regeneration device 70, is recorded to the record medium 42 as "Audio Tag 2" together with the 
captured image data. 
[0050] 

At S164 "RECORD Audio Tag 3", the audio play time data, received from the audio 
regeneration device 70, is recorded to the record medium 42 as "Audio Tag 3" together with the 
captured image data. 
[0051] 

At SI 66 "RECORD Audio Tag 4", the regeneration track order data, received from the audio 
regeneration device 70, is recorded to the record medium 42 as "Audio Tag 4" together with the 
captured image data. 
[0052] 

At S168 "RECORD IMAGE DATA", the captured image data is recorded to the record 
medium 42. As the image-capturing mode is released, the program proceeds to SI 70 "END" and 
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finishes the image-capturing routine. If the shutter is half-pressed without releasing the 
image-capturing mode, the program returns to SI 54 and again prepares for image-capturing. 
[0053] 

Figure 4 is a timing chart showing a process for capturing an image during the audio 
regeneration, and automatically regenerating the recorded image while performing automatic audio 
regeneration by using the electronic camera and its recording and regenerating method according to 
an embodiment of the present invention. Figure 5 is a flowchart showing the process. As an 
image regeneration mode is designated in the electronic camera 8, the program jumps to the routine 
in Figure 5. 
[0054] 

In Figure 4, data to be recorded in an image file of "Image 1 " are a title "ABC" in the Audio 
Tag 1, a track number "1" at audio regeneration in the Audio Tag 2, and an audio play time "1:03" 
in the Audio Tag 3 together with the image data of "Image 1". A regenerating tune order data, 
also recorded in the "Image 1 ", is initially recorded in the Audio Tag 4, but nothing is recorded in 
the regeneration track data in a case where the image is captured during the audio regeneration. 
Similarly, the data mentioned above are recorded also in "Image 2" and "Image 3" and so on 
following "Image 1". 
[0055] 

As regeneration of music of "track 1 " is started, the image of "Image 1 " is displayed after a 
predetermined background audio regeneration time ivtl . The image is displayed during an image 
display time itt, and the sound is simultaneously being regenerated. As the image display is 
completed, the audio regeneration of "TRACK 1 " is completed after a predetermined background 
audio regeneration time ivt2, and the program moves on to the audio regeneration of "TRACK 3". 
The following regeneration of the image and sound are automatically performed in the same 
manner. 
[0056] 

In Figure 5, an image to be regenerated is selected at SI 80 "SELECT IMAGE, SELECTED 
NUMBER = T" while referring to a preview screen, then the program proceeds to SI 82 "N = 0". 
At SI 82, 0 is substituted for the variable indicating the number of regenerated image or images. 
[0057] 
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When pressing the regeneration switch which is provided to the audio regeneration device 70 
at SI 86 "AUDIO REGENERATION SWITCH ON", the execution program of the electronic 
camera 8 is advanced to SI 84 "REGENERATE SELECTED IMAGE DATA" via the 
communication part which is provided between the audio regeneration device 70 and the electronic 
camera 8. 
[0058] 

At SI 84, an input from the image regeneration button provided to the electronic camera 8 is 
in a stand-by state. As the image regeneration button is pressed, regeneration and display of the 
image are started and the execution program proceeds to SI 88 "N = N + 1", then 1 is added to the 
variable indicating the number of regenerated images. 
[0059] 

At SI 90 "Audio Tag 1 EXISTS?", whether or not data is written in "Audio Tag 1" is 
determined. If it is determined that the data is written in "Audio Tag 1" at SI 90, the program 
diverges to S192 "MEDIUM IN AUDIO REGENERATION DEVICE?", and the electronic camera 
8 checks to the audio regeneration device 70 via the communication part whether or not the medium 
exists in the audio regeneration device 70. If the medium exists in the audio regeneration device 
70, the program diverges to S194 "CORRESPONDENCE BETWEEN Audio Tag 1 AND THE 
AUDIO MANAGEMENT DATA", and the electronic camera 8 checks to the audio regeneration 
device 70 whether or not Audio Tag 1 and the audio management data correspond with each other. 
If Audio Tag 1 and the management data correspond with each other, the program proceeds to SI 96 
"CHECK Audio Tag 2". 
[0060] 

If it is determined that no data is written in "Audio Tag 1" at SI 90, or if no medium exists at 
S192, or if Audio Tag 1 and the audio management data do not correspond with each other at S194, 
the program proceeds to S212 "LCD DISPLAY TIME L - 0", and executes the process to display 
the designated image data only. 
[0061] 

At S196, a track number, written in "Audio Tag 2", is read, and an instruction for reading out 
the track number which is written in "Audio Tag 2" at SI 98 "RETRIEVE TRACK NUMBER" is 
transmitted to the audio regeneration device 70 via the communication part. Then, the execution 
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program of the audio regeneration device 70 proceeds to S200 "START AUDIO 
REGENERATION FROM Audio Tag 3 ivtl", and starts the audio regeneration. After that, at 
S202 "AUDIO REGENERATION TIME = Audio Tag 3?", when the audio regeneration time 
corresponds with the time ivtl after the start of audio regeneration, that is, when the audio 
regeneration time corresponds with "Audio Tag 3", an instruction for displaying the image of 
"Image 1 " is transmitted to the electronic camera 8 via the communication part. 
[0062] 

The electronic camera 8 displays the image of "Image 1" at S214 when ivtl has passed after 
the audio regeneration device 70 starts the audio regeneration. Then at S216 "L > itt ?", a process 
is performed for waiting until the image display time L is reached at or passed the itt. As the 
image display time L reaches at or passed the itt, the program proceeds to S218 "LCD NOT 
DISPLAYED", and suspends LCD display. 
[0063] 

The program then proceeds to determination at S204 "AUDIO REGENERATION TIME > 
Audio Tag 3 + ivtl + ivt2 ?", and waits until the audio regeneration time reaches at "Audio Tag 3 + 
ivtl + ivt2". As the audio regeneration time reaches at "Audio Tag 3 + ivtl + ivt2", the program 
proceeds to S206 "AUDIO REGENERATION COMPLETED", and finishes the audio regeneration. 
[0064] 

At S208 "N = T", whether or not the images are displayed by the number which is selected at 
S 180 is determined. In a case where the images are displayed by the selected number (i.e., if N = 
T), the program proceeds to S210 (END) to finish the subroutine. In a case where the images are 
not displayed by the selected number (i.e., if N < T), the program returns to SI 84, and repeatedly 
executes the process to sequentially perform the next audio regeneration and image display. 
[0065] 

Figure 6 is a timing chart showing a process for capturing an image during audio 
regeneration, and manually regenerating the recorded image while automatically regenerating sound 
by using the electronic camera according to an embodiment of the present invention. Figure 7 is a 
flowchart showing the process. As a mode to manually regenerate the image is designated in the 
electronic camera 8, the program jumps to the routine in Figure 7. 
[0066] 



- 17- 



In Figure 6, data to be recorded in the image file of "Image 1" are the title "ABC" in Audio 
Tag 1, the track number "1" at audio regeneration in Audio Tag 2, and the audio play time "1:23" in 
Audio Tag 3. The regeneration tune order data, also recorded in "Image 1 ", is initially recorded in 
the Audio Tag 4, but nothing is recorded in a case where the image is captured during the audio 
regeneration. Similarly, the data mentioned above are recorded to the image file of "Image 2" 
following "Image 1". 
[0067] 

As regeneration of music of "TRACK 1 " is started, an image of "Image 1 " is displayed after 
a predetermined background audio regeneration time ivtl. The image is continuously displayed, 
and the sound simultaneously is being regenerated as background. The image display is 
completed when the user presses a "NEXT BUTTON" which is provided to the input unit of the 
electronic camera 8 whereby the audio regeneration and the image display of the "Image 1" are 
completed. The program moves on to the audio regeneration of the next "TRACK 4", and image 
display of "Image 2" is performed. The following regeneration of the image and sound is 
automatically performed in the same manner by pressing the "NEXT BUTTON". To suspend the 
image display, the user presses an "IMAGE REGENERATION COMPLETION BUTTON" which 
is provided to the input unit 26 of the electronic camera 8. 
[0068] 

In Figure 7, the image regeneration switch is pressed which is provided to the input unit 26 
of the electronic camera 8 at S220 "IMAGE REGENERATION SWITCH ON" and the audio 
regeneration switch is pressed which is provided to the audio regeneration device 70 at S222 
"AUDIO REGENERATION SWITCH ON", thereby audio regeneration start data is transmitted to 
the electronic camera 8 via the communication part, and the execution program of the electronic 
camera 8 proceeds to S224 "IMAGE SELECTION". 
[0069] 

At S224 "IMAGE SELECTION", an image to be regenerated is selected while referring to a 
preview screen, then the program proceeds to S226 "REGENERATE SELECTED IMAGE 
DATA". 
[0070] 
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At S226, an input from the image regeneration button provided to the electronic camera 8 is 
in a stand-by state. As the image regeneration button is pressed, regeneration and display of the 
image are started and the execution program proceeds to S228 "Audio Tag 1 EXISTS?". 
[0071] 

At S228 "Audio Tag 1 EXISTS?", whether or not the data is written in "Audio Tag 1" is 
determined. If it is determined that the data is written in "Audio Tag 1 " at S228, the program 
diverges to S230 "MEDIUM IN AUDIO REGENERATION DEVICE?", and the electronic camera 
8 checks via the communication part whether or not the medium exists in the audio regeneration 
device 70. If the medium exists in the audio regeneration device 70, the program diverges to S232 
"CORRESPONDENCE BETWEEN Audio Tag 1 AND AUDIO MANAGEMENT DATA", and 
the electronic camera 8 checks to the audio regeneration device 70 whether or not Audio Tag 1 and 
the audio management data correspond with each other. If Audio Tag 1 and the management data 
correspond with each other, the program proceeds to S234 "CHECK Audio Tag 2". 
[0072] 

If it is determined that no data is written in "Audio Tag 1" at S228, or if no medium exists at 
S230, or if Audio Tag 1 and the audio management data do not correspond with each other at S232, 
the program proceeds to S246 "DISPLAY LCD", and executes the process to display the designated 
image data only. 
[0073] 

At S234, the track number, written in "Audio Tag 2", is read, and an instruction for reading 
out the track number which is written in "Audio Tag 2" at S236 "RETRIEVE TUNE OF TRACK 
NUMBER" is transmitted to the audio regeneration device 70 via the communication part. Then, 
the execution program of the audio regeneration device 70 proceeds to S 23 8 "START AUDIO 
REGENERATION FROM Audio Tag 3-ivtl", and starts the audio regeneration. After that, when 
the audio regeneration time corresponds with the time ivtl after the start of audio regeneration at 
S240 "AUDIO REGENERATION TIME = Audio Tag 3?", that is, when the audio regeneration 
time corresponds with "Audio Tag 3", an instruction for displaying the image of "Image 1" is 
transmitted to the electronic camera 8 via the communication part. 
[0074] 
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If ivtl > 0, the electronic camera 8 displays the image of "Image 1" at S246 when ivtl has 
passed after the audio regeneration device 70 starts the audio regeneration. If ivtl < 0, the audio 
regeneration device 70 starts audio regeneration when ivtl has passed after displaying the image of 
"Image 1 " at S246. Then at S248, a process is performed to wait until a "NEXT BUTTON" is 
pressed at S248 "NEXT BUTTON ON". If the "NEXT BUTTON" is not pressed, the electronic 
camera 8 outputs to the audio regeneration device 70 via the communication part an instruction to 
continue the audio regeneration, thereby a process of S242 "AUDIO REGENERATION" continues 
in the execution program of the audio regeneration device 70. 
[0075] 

As the "NEXT BUTTON" is pressed, the program proceeds to S250 "LCD NOT 
DISPLAYED", and suspends the LCD display, then outputs to the audio regeneration device 70 via 
the communication part an instruction to finish the audio regeneration. In the execution program 
of the audio regeneration device 70, the process at S244 "AUDIO REGENERATION 
COMPLETED" is executed. 
[0076] 

At S252 "REGENERATION BUTTON OFF", whether or not the regeneration button is 
OFF is determined. If the regeneration button is not OFF (image regeneration is not completed), 
the program returns to S224 and the image selection is performed again. If the regeneration button 
is OFF (image regeneration is completed), the program proceeds to S254 to finish the subroutine. 
[0077] 

Figure 8 is a timing chart showing a process for automatically regenerating the image 
captured and recorded considering a link with the audio regeneration while automatically 
regenerating sound by using the electronic camera and its recording and regenerating method 
according to an embodiment of the present invention. Figures 9 and 10 are flowcharts showing the 
process. When an image regeneration mode is designated in the electronic camera 8, the program 
jumps to the routine in Figure 9. 
[0078] 

In Figure 8, data to be recorded in an image file of "Image 1" are a title "ABC" in the Audio 
Tag 1, a track number "5" at audio regeneration in the Audio Tag 2, an audio play start time "0:00" 
in the Audio Tag 3, and regenerating tune order data in the Audio Tag 4 together with the image 
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data of "Image 1". Similarly, the data mentioned above are recorded also in "Image 2" following 

"Image 1". 

[0079] 

As regeneration of background music of "track 1 " is started, the image of "Image 1 " is 
displayed simultaneously. The image is continuously displayed while the sound is regenerated at 
the background. The image display is completed at the time "3:30" of the Audio Tag 3 which is 
recorded in the "Image 2". After the time "3:30", the image data of "Image 1" is substituted by 
"Image 2". Afterward, regeneration of the image and sound is similarly performed automatically. 
[0080] 

In Figure 9, the image regeneration switch which is provided to the input unit 26 of the 
electronic camera 8 is pressed at S260 "IMAGE REGENERATION SWITCH ON", and at the same 
time the audio regeneration switch which is provided to the audio regeneration device 70 is pressed 
at S262 "AUDIO REGENERATION SWITCH ON", thereby the audio regeneration start data is 
transmitted to the electronic camera 8 via the communication part, and the execution program of the 
electronic camera 8 proceeds to S264 "IMAGE SELECTION". 
[0081] 

An image to be regenerated is selected at S264 "IMAGE SELECTION" while referring to a 
preview screen, and the program proceeds to S266 "Audio Tag 1 EXISTS?". 
[0082] 

At S266 "Audio Tag EXISTS?", whether or not data is written in "Audio Tag 1" is 
determined. If it is determined that the data is written in "Audio Tag 1 " at S266, the program 
proceeds to S268 "MEDIUM IN AUDIO REGENERATION DEVICE?". If no data is written in 
"Audio Tag 1", the program diverges to S274 "END" to finish the subroutine. 
[0083] 

At S268, the electronic camera 8 checks the communication part whether or not medium 
exists in the audio regeneration device 70. If the medium exists in the audio regeneration device 
70, the program proceeds to S270 "CORRESPONDENCE BETWEEN Audio Tag 1 AND THE 
AUDIO MANAGEMENT DATA". If no medium exists in the audio regeneration device 70, the 
program proceeds to the S274 "END" to finish the subroutine. 
[0084] 
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At S270, the electronic camera 8 checks to the audio regeneration device 70 via the 
communication part whether "Audio Tag 1 " and the audio management information correspond 
with each other. If the "Audio Tag 1" and the audio management information correspond with 
each other, the program proceeds to S272 "Audio Tag 4 OF SELECTED IMAGE EXISTS?". If 
the "Audio Tag 1" and the audio management information do not correspond with each other, the 
program diverges to S274 "END" to finish the subroutine. 
[0085] 

At S272, whether or not data is written in "Audio Tag 4" is determined. If it is determined 
that the data is written in "Audio Tag 4", the program proceeds to S276 "IMAGE SEARCH 
(correspondence between Tag 1 and Tag 4), SELECTED NUMBER = T". If it is determined that 
no data is written in "Audio Tag 4", the program diverges to S274 "END" to finish the subroutine, 
and the process at and after S246 shown in Figure 7 is executed. 
[0086] 

At S276, an image in which "Tag 1" and "Tag 4" correspond with each other is retrieved, 
and all the retrieved images are determined as images to be regenerated. 
[0087] 

At S278 "SORT IN TIME ORDER OF Tag 3 BY TUNE ORDER OF Tag 4", images are 
sorted in the time order Tag 3 by the tune order Tag 4, and an order of tunes is set at S280 "SET 
TUNE ORDER FROM Audio Tag 4" . 
[0088] 

At S280 "N = 1", a value which indicates that the first image is being processed is 
substituted for "N", and the program proceeds to S282 "CHECK Audio Tag 2 OF N-TH IMAGE". 
[0089] 

At S282, an instruction to check the track number of the N-th image is outputted to the audio 
regeneration device 70, and the program proceeds to S284 "CHECK Audio Tag 3 OF N-TH 
IMAGE". 
[0090] 

At S284, an instruction to check the audio regeneration time for the N-th image is outputted 
to the audio regeneration device 70. 
[0091] 
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The program for executing control of the audio regeneration device 70 retrieves a track 
number to be regenerated at S294 "RETRIEVE TUNE OF TRACK NUMBER". 
[0092] 

At S296 "AUDIO REGENERATION", the audio data of the designated track number is 
regenerated. Then at S298 "Audio Tag 2 OF N-TH IMAGE = TRACK NUMBER?", whether or 
not the designated track number is the track number of the N-th image is determined. If it is 
determined that the designated track number is the track number of the N-th image, the program 
proceeds to S300. If it is determined that the designated track number is not the track number of 
the N-th image, the program returns to S296. 
[0093] 

If it is determined at S300 "AUDIO REGENERATION TIME = Audio Tag 3 FOR N?" that 
the audio regeneration time is not equal with the regeneration time which is recorded in Audio Tag 
3 for N, the program returns to S296. If the audio regeneration time reaches at an equal time with 
the regeneration time which is recorded in Audio Tag 3 for N, the program proceeds to S286 "LCD 
NOT DISPLAYED" and S302 "TUNE COMPLETED". 
[0094] 

In response to the determination at S300 that the audio regeneration time is equal with the 
regeneration time which is recorded in Audio Tag 3, the image display on the display means 56 is 
suspended at S286. At S288 "REGENERATE N-TH IMAGE DATA", displaying for the next 
image is prepared, and image display is performed at S290 "DISPLAY LCD". The program 
proceeds to S292 "N = N + 1", and 1 is added to the variable "N" which indicates that the N-th 
image is processed, then the program returns to S282. 
[0095] 

When a tune currently regenerated at S302 is finished, the program returns to S294 so as to 
regenerate the next tune. If regeneration for all tunes is finished, the program proceeds to S304 
"ALL TUNES COMPLETED", and finishes the subroutine at S306 "END". 
[0096] 

By the above method, the images are displayed on the LCD whenever Audio Tag 2 and 
Audio Tag 3 for the selected image correspond with the audio regeneration time and the track 
number. 
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[0097] 

[Advantages of the Invention] 

As described above, the electronic camera of the present invention records the audio 
regeneration information which at least indicates where the sound during the audio regeneration is 
stored at the time of capturing in the record medium together with the captured image data. 
Therefore, the recorded image and its corresponding sound can be automatically regenerated at the 
time of regeneration, so that the image and sound can be easily appreciated simultaneously. 
[0098] 

Moreover, in another embodiment, the sound corresponding with the image can be 
automatically regenerated in accordance with the audio regeneration information which is recorded 
in the record medium. Therefore, the image and the sound can be easily appreciated simultaneously. 
[Brief Description of the Drawings] 
[Figure 1] 

A block diagram showing an embodiment of the electronic camera according to the present 
invention. 
[Figure 2] 

A flowchart showing a process for capturing an image during audio regeneration by using 
the electronic camera and its recording and regenerating method according to the present invention. 
[Figure 3] 

A flowchart showing a process for capturing an image considering a link with audio 
regeneration by using the electronic camera and its recording and regenerating method according to 
the present invention. 
[Figure 4] 

A timing chart showing a process for capturing an image during audio regeneration and for 
automatically regenerating the recorded image while automatically regenerating sound by using the 
electronic camera and its recording and regenerating method according to the present invention. 
[Figure 5] 

A flowchart showing the process for capturing the image during the audio regeneration and 
for automatically regenerating the recorded image while executing automatic audio regeneration by 
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using the electronic camera and its recording and regenerating method according to the present 

invention. 

[Figure 6] 

A timing chart showing a process for capturing an image during audio regeneration and 
manually regenerating the recorded image while automatically regenerating sound by using the 
electronic camera and its recording and regenerating method according to the present invention. 
[Figure 7] 

A flowchart showing the process for capturing the image during the audio regeneration and 
manually regenerating the recorded image while automatically regenerating sound by using the 
electronic camera and its recording and regenerating method according to the present invention. 
[Figure 8] 

A timing chart showing a process for automatically regenerating a captured and recorded 
image considering a link with audio regeneration while automatically regenerating sound by using 
the electronic camera and its recording and regenerating method according to the present invention. 
[Figure 9] 

A flowchart showing the process for automatically regenerating the captured and recorded 
image considering the link with the audio regeneration while automatically regenerating sound by 
using the electronic camera and its recording and regenerating method according to the present 
invention. 
[Figure 10] 

A flowchart showing the process for automatically regenerating the captured and recorded 
image considering the link with the audio regeneration while automatically regenerating sound by 
using the electronic camera and its recording and regenerating method according to the present 
invention. 
[Description of Symbols] 

8 . . .ELECTRONIC CAMERA; 10...LENS; 14...CCD (SOLID-STATE IMAGING DEVICE); 
16...IMAGE SIGNAL PROCESSING PART; 18...IMAGING TIMING CONTROL PART; 
22...CONTROL PART; 42...RECORD MEDIUM; 44 . . .RECORDING-REGENERATING 
PROCESSING PART; 46...COMMUNICATION SIGNAL PROCESSING PART; 
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52.. .REGENERATION SIGNAL PROCESSING PART; 70...AUDIO REGENERATION 
DEVICE; 72...COMMUNICATION LINE 
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[Title of the Document] Abstract 
[Abstract] 

[Problem to be Solved] 

To provide an electronic camera which records audio regeneration information in a record 
medium when image-capturing, and which is capable of performing audio regeneration in 
accordance with the audio regeneration information during image regeneration process. 
[Solution] 

Audio regeneration information at least indicating where sound during audio regeneration is 
stored is recorded in a record medium 42 together with captured image data when image-capturing. 
The image data recorded in the record medium 42 and the audio regeneration information is read 
during image regeneration process. The image is displayed in accordance with the image data 
while the sound during the image-capturing is regenerated in accordance with the audio 
regeneration information. Therefore, the image and the sound can be easily appreciated 
simultaneously and the image regeneration can be effectively enjoyed. 
[Selected Drawing] Figure 1 
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[Title of the Document] Drawings 
[Fig. 1 ] 
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